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Abstract. 

The synchronous dynamics and the stationary states of a recurrent attractor 
neural network model with competing synapses between symmetric sequence 
processing and Hebbian pattern reconstruction is studied in this work allowing for 
the presence of a self-interaction for each unit. Phase diagrams of stationary states 
are obtained exhibiting phases of retrieval, symmetric and period-two cyclic states 
as well as correlated and frozen-in states, in the absence of noise. The frozen-in 
states are destabilised by synaptic noise and well separated regions of correlated 
and cyclic states are obtained. Excitatory or inhibitory self-interactions yield 
enlarged phases of fixed-point or cyclic behaviour. 
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1. Introduction 

The asymptotic stationary states of large recurrent attractor neural network models 
trained with sequences of patterns have been studied some time ago p]-[l0] and 
there has been a recent revival of interest near the storage saturation of patterns 
[TT]-[T7]- Besides network models for asymmetric sequence processing, models with 
synapses generated by symmetric sequences competing with pattern reconstruction 
favoured by Hebbian synapses have been studied in some of those works [3[ 2[ [HI US] • 
These are models with an underlying asynchronous dynamics and phase diagrams were 
obtained which only exhibit fixed-point solutions, in particular correlated attractors, 
in accordance with a general expectation for networks with symmetric interaction 
matrices far from the storage saturation limit in which the ratio a — p/N of the 
number of stored patterns p and the number of neurons N is zero, in the large N limit. 
In contrast, in the case of a synchronous dynamics with symmetric interactions the 
stationary states may be either fixed-points or cycles of period two, in the same limit 
[TB] , Rhythmic activity appears in neurobiological systems [TD] and the competition 
between these features may yield interesting clues. 

The presence of self- interactions of the units, which is consistent with detailed 
balance in the synchronous dynamics of a network with a symmetric interaction 
matrix, has not been considered so far except in Little's model which has a simple 
Hebbian learning rule [2D]- [25 . The role of self-interactions which may be either 
excitatory or inhibitory, is to control the fraction of spin flips in the dynamics. 
Excitatory interactions may enhance the retrieval performance while inhibitory 
interactions can give rise to cyclic behaviour. Self-interactions and their relationship 
to initial overlaps play a crucial role in Little's model leading to frozen-in cycles of 
period two among other features, in the absence of noise [211 [22] . In a recent work it 
has been shown that these cycles are destabilised in a slow dynamical process either by 
synaptic or stochastic noise due to a macroscopic number of stored patterns 25j. This 
raises concern about the stability of cycles of period two in general in the synchronous 
dynamics of networks with symmetric interactions for the specific interesting case of 
symmetric sequence processing competing with Hebbian synapses. 

There has been great interest in models with symmetric sequential interactions 
due to the presence of correlated fixed-point attractors [4[ [8[ [TBI HI], which are 
stationary states that emerge from a balanced competition between sequential and 
Hebbian synapses. They indicate a selectivity in response to a set of previously learned 
uncorrelated patterns by means of decreasing correlation coefficients for the attractors 
with increasingly distant patterns from a stimulus. Correlated attractors have been 
used to explain the results of experimental recordings of a visual-memory task in the 
infcrotemporal cortex of monkeys [26j-[29]. In the case of a synchronous dynamics, the 
correlated fixed-point states might be destabilised by the presence of a macroscopic 
number of flipping spins giving rise to oscillatory overlaps. 

The asymptotic states of a feed-forward layered neural network model for 
competing symmetric sequence processing with Hebbian synapses have been discussed 
in a recent work [30] . The model is described by a synchronous dynamics and it is 
characterised by asymmetric synaptic connections between units in two consecutive 
layers and there are neither lateral synapses between units in the same layer nor self- 
interactions of the units. Phase diagrams of stationary states were obtained exhibiting 
retrieval states, correlated states, symmetric mixture states and stable cycles of period 
two, for increasingly larger fractions of sequential synapses. All of these states are 
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robust either to synaptic noise or to stochastic noise due to a macroscopic number of 
stored patterns. 

The purpose of the present paper is to study the synchronous dynamics and 
the asymptotic states of a recurrent network model of binary units and patterns for 
competing interaction between symmetric sequence processing and Hebbian synapses, 
in order to investigate the presence and stability of cycles of period two and of other 
states which could be competing with the retrieval and with the correlated states. We 
make use of a generating functional approach (GFA) for the dynamics of disordered 
systems [111 131] , which is an exact procedure in the mean-field limit, and we use an 
adaptation of the numerical simulation procedure of Eissfeller and Opper (EO) [32] 
based on the GFA in order to implement the calculation of single-site averages. We 
also resort to a recently introduced alternative approach [25] , 

The outline of the paper is the following. We introduce the model in section 2 and 
present a brief summary of the well known GFA and the EO procedure in section 3 as 
well as explicit dynamic recursion relations for the overlaps. We present our results for 
the phase diagrams in section 4 and conclude with a summary and further discussion 
in section 5. 

2. The model 

We consider a network of N Ising neurons in a microscopic state <r* = (p\, . . . , cr^), 
at the discrete time-step t in which each cr| = ±1 represents the state of an active or 
inactive neuron, respectively. The states of all neurons are updated simultaneously at 
each time-step according to the alignment of each spin with its local field 

3 

following a microscopic stochastic single spin-flip dynamics with transition probability 

^K t+1 |^) = ^[l + ^ +1 tanh(/3^)] (2) 

ruled by the synaptic noise control parameter (3 = T . Here, Jy is the synaptic 
coupling between neurons i and j and 9\ is an external stimulus. The dynamics is a 
deterministic one when T = and fully random when T = oo. In the former case, 
o-l +1 = sgn(/4). 

A macroscopic set £ M = (£f , . . . , fi = 1, . . . ,p of p = aN independent and 
identically distributed quenched random patterns, each £j* = ±1 with probability i 
is embedded in the network by means of the synaptic coupling between distinct 
neurons i and j. One may think of j and i as pre- and post-synaptic neurons, 
respectively, the activities of which give rise to that coupling. We assume, as usual, 
that a finite number c of patterns is condensed so that the overlaps with the state of 
the network, defined below, are finite and responsible for the signal in the local field. 
The remaining macroscopic number of p — c non-condensed patterns will give rise to 
the noise in the local field. To be specific, we assume that the condensed patterns are 
cyclic so that £ c+1 = £\ 

The non-condensed patterns need not be embedded in the network by the same 
learning rule as that for the condensed patterns. Indeed, one may think that those 
patterns have been learned in a previous stage, in accordance with an argument that 
has been used before [3]. We make use of this freedom in order to simplify the calcu- 
lations by assuming a Hebbian rule for the non-condensed patterns. Guided by work 
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on the layered feed- forward network [30] , we expect qualitatively the same results as 
those obtained here for the same learning rule for condensed and non-condensed pat- 
terns. Thus, altogether, we take a synaptic coupling of the form 

fl—l fl—l fJ,—C~\- 1 

= J if i = j , (3) 



in which each value of v (0 < v < 1) defines a model so that when v — 1 we get Little's 
model with a Hebbian rule and when i/ = 0we have the purely symmetric sequential 
model. The first and the second summations are responsible for the signal in the local 
field while the last summation is responsible for the noise and we comment on that 
term in section 5. The self-interaction Jo is a real non-random variable which can take 
any positive or negative value enhancing or inhibiting, respectively, the local field in 
the form of a pattern-independent contribution Jo<7*. It either tends to enforce the 
actual state of unit i, if J is positive, or to switch the state if Jq is negative. 



3. The dynamic generating functional approach 

The dynamical evolution of the system is described by the moment generating 
functional [11] 

t 

Z(VO = (exp(-iEE^ 

i s=0 

t 

= E Prob(,rV.., ( T t )exp(-iEE^) < ( 4 ) 
<j a ,...,cr t i s=o 

where i/> s = (ipf , . . . , ipfj) is a set of auxiliary variables that serve to generate averages 
of moments of the states and the brackets denote an average over all possible paths 
of states with probability 

P„ b ,.v..x,^,'nn!^^ o 

that follows from (2). Assuming that for N — * oo only the statistical properties of the 
stored patterns will influence the macroscopic behaviour of the system, one obtains the 
relevant quantities which are the overlap of O(l) with any one of the condensed 
patterns £ M , the two-time correlation function Cti and the response function Gti, given 

by 



and 



1 v-^ d{a\) . 1 v-^ d 2 Z(iP) . , , 

Gu = — > =i hm — > (I < t) , (8) 
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where the bar denotes the configurational average with the non-condensed patters {£ p } 
(p = c + 1, . . . ,p) and the restriction I < t is due to causality. The two-consecutive- 
time correlation function has a particular meaning since q t — Ctj-i gives the fraction 
of flipping spins between two consecutive times as (1 — q t )/2. 

Following the now standard procedure in which the disorder average is done before 
the sum over the neuron states one obtains exactly, in the large N limit, the generating 
functional [111 [32] 



I 

zm=( e P (o«p(-iEEv'' o f) 

Cro,...,<T* i s=0 

Y[n[jdh*s(ht-K S )w(o-- 



(9) 



in which p(cr a ) — Y[iP( a i) ^ s t ne probability of the initial microscopic configuration 
while (•■■){0t} denotes an average over a set of temporarily correlated Gaussian 
random variables {</>'} for unit i, with zero-average and a correlation matrix given 
below. The random variables on different units turn out to be uncorrelated and one 
is left with a single-site effective theory in which a neuron evolves in time according 
to the transition probability 

U r t+1 tanh (phis) 



w(<r t+1 |/4 ff ) 



1 



(10) 



with an effective local field given by 

= E ^v! 

fl,p<C 



where 



A„ 



P + C 1 _ v ) P+l + ^, p-i) 



(11) 



(12) 



and we assumed that 6'* = 0. The two non-trivial contributions to the effective local 
field for a > come from a retarded self-interaction involving the matrix elements 

R ta = [G{I-G)- 1 \ u (13) 

and the zero-average temporarily correlated Gaussian noise (jr with variance 

S u = (0V*){**} - [(J - G)^ 1 C(7 - G^)- 1 ]^ . (14) 

Here, C and G are matrices with elements {Ct s } and {Gt s }, respectively. Both 
contributions account for memory effects in the network that come from the noise 
in the original local field due to the macroscopically large number of non-condensed 
patterns. 

The dynamics of each of the macroscopic quantities, given by ([MEli is obtained 
from the statistics of the effective single neuron process through the average 



</(o-)>* = / d0P(0)E p M^)/( ff ) > 



(15) 



where er = {er*} and cp = {</>'} are now single-site vectors that follow a path in discrete 
times, and 



V{cT\cp)=p{a°)X{^(o-^\Ks) 



(16) 



s<t 
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P(0)= 7 ==^ ==exp(-|0.5- 1 0j ■ (17) 



is the single-spin path probability given the Gaussian noise <j> in the effective field, 
with a distribution 

1 / 1 

A /(27r) t (dctS) 

In order to obtain the full dynamic description of the transients for a > 0, we 
make use of the procedure of Eissfeller and Opper in which the effective single-site 
dynamics given by (|10M17|) is simulated by a Monte-Carlo method. There are no finite- 
size effects, but a large number Nt of stochastic trajectories has to be generated for 
the single-site process in order to keep the numerical error small. The macroscopic 
parameters can then be obtained from the average 

</(°-)>* = ^£/(^). ( 18 ) 

a—1 

where <r a denotes the spin along the path a. The number of stochastic trajectories 
Nt should not be confused with the number of neurons N, which goes to infinity. 
The specific algorithm that implements the EO method is described in the literature 

[321 M- 

For a finite loading of patterns (a = 0) we can obtain analytically recursion 
relations for the condensed overlaps and expressions for the correlation coefficients 
defined below. In this case the effective local field ([TT]) assumes the form 

h ls = E ^ A w m \ + J o^ > (19) 

so that P(<t|0) becomes <f> independent and the integral over <f> in (|15p equals unity. 
Now h e fi still depends on the microscopic state of the system at time step t and in 
order to calculate the sum over the paths in the average (cr*)* we follow the procedure 
introduced in [55] ■ Assuming an initial distribution p(a°) = |[1 + er°£; A m°], which 
corresponds to an initial vector overlap with components m° = 8^\m\ (fi = 1, . . . , c), 
the following system of recurrence relations can be derived 

(cr* +1 )„ = i(l + <CT t )*)tanh/3(£.Am t + J ) + 1(1 - tanh^.Am* - J ) ,(20) 



2 V x ' ' ' ^ u/ 2 



ml = {e^%)^, (21) 
with i.Am* = Y.p,p<c^ LA w mt p and (°"°)* = 'E*°P(v°)v° = C X m° x . At a time step t, 



,1 .,,,,1 :„■<<■■ — sr ... >„- :1 — < \ ,.. n 

one has to update all the 2 C possible values of the single-site average (cr 4 )* by means 
of (|20"|) . each one related to a given realization of £. This procedure allows to calculate 
the overlaps at the same time step through (|2"Tj) . For v = 1 and c = 1, (f2T)]) and 
(|2ip can be written as a single recurrence relation for the overlap with one condensed 
pattern and one recovers the results for Little's model [25 . 

In this work we are also interested in studying the correlation between the 
stationary states of the network generated by different initially stimulated patterns. 
Defining {(cr^)} (i = 1, . . . , N) as the stationary state corresponding to a stimulus in 
pattern A, represented by an initial condition on the overlaps of the form = S^xm^ 
(fi = 1, . . . , c), the normalised correlation coefficient between two stationary states is 
defined by [4] 

Cxp " EJL.W)' ■ 1 ' 
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We may use the self-average property to write (|2"2")1 in the large-N limit, for a = 0, as 

Cxp WWt ' 

where (cr A )* and (er p )* are determined by the fixed-point solutions of (|20[) and (piTj) . 
When a 7^ the summations over sites in (f2"2"j) can no longer be replaced by the 
averages over patterns in (|23[) . but one may use the similarity of the overlap vector 
with that at a — as a guide to decide if one is in the presence of a correlated state 
or not. In this model, the structure of the stationary overlap vector is the same when 
different initially stimulated patterns are considered. Thus the correlation coefficient 
C\ p depends only on the distance d = |A — p\ between the patterns in the sequence. 
The correlated stationary states one is interested in a visual-memory task are those for 
which the decreasing correlation coefficients vanish (or almost vanish) for increasing 
d, indicating a clear selectivity with respect to the patterns in the sequence. 

4. Results 

We focus mainly on phases of retrieval, cyclic and correlated fixed-point states. All 
the explicit results shown in this section were obtained assuming an initial overlap 
= m\8pi (/j, = 1, . . . , c), with m\ — 0.4. The reason for this choice in place of the 
more popular m\ = 1 which favours the retrieval phase is to be within the basin of 




Figure 1. Phase diagram of stationary states for c = 10 condensed patterns, 

a = = T and initial overlap mjj = 0.4<5 M i (fj, = 1, , c). R is a retrieval phase, 

S is a phase of symmetric-like states, E is a phase of period-two cycles, the grey 
area is a phase of correlated fixed-point states, F\ and F2 are phases of frozen-in 
fixed-point and period-two cyclic states, respectively. 

attraction of the other phases of interest for convenient values of Jo- 

We consider in this work c = 10 condensed patterns in all the cases studied, which 
is suitable due to the following. First, an interesting sequence for associative-memory 
tasks should not be too short. Second, we expect that already for a value of c of this 
size the phase diagrams should only exhibit small quantitative differences in the phase 
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boundaries for different values of c, guided by the results for the feed-forward network 
[50] . Third, we are interested in fixed-point correlated states [3J 2] , characterised by 
well-defined correlation coefficients that decrease down to a vanishingly small value 
for the largest d which should not be too small. 

Although only few results can be derived analytically (see below) due to the 
complexity of the problem, all the features of the phase diagrams can be obtained 
numerically for a = 0. We show first the results in that case for the stationary 
behaviour obtained by means of the iteration of ([20]) and (|2T|) until a stationary overlap 
vector m is reached. The (u, Jo) phase diagram of stationary states in the absence of 
noise (a = = T) is shown in figure Q] Given a value of v (which defines a model) and 
the initial overlap with the condensed patterns that specifies the basins of attraction 
of the phases of interest, the size and the sign of the self-interaction Jo yields the 
various stationary phases as indicated. The variety of the phases is also investigated 
studying the behaviour of the system as a function of the model parameter is, for a 
given J . 

For large values of | Jo | , there is a phase Fi of frozen- in fixed-points for positive Jo , 
with an overlap = 0.4(5^1 (jj, = 1, . . . , c) that stays the same as the initial overlap 
for all times, and there is a phase F2 of frozen- in cycles for negative Jo, with an overlap 
ml = (— 1)*0.4 (/1 = 1, . . . , c) that keeps switching between the initial overlap and 
its opposite. The phase boundaries of Fx and F 2 can be derived analytically from 
(|20p and (f2Tj) in the T — ► limit iterating the condensed overlaps at consecutive 
times. Writing the initial overlap as m ^ = m x Sfj,\ (/•* = 1, ...,c), for a general m x 
(0 < mP x < 1), this yields first an expression for m\ at the first time step in terms of 
Jo, v and m\. The conditions that m\ — m° or m\ — —m\ (the case for F\ or F2, 
respectively) are 

Jo > m° x (2 - v) , phase Fi (24) 
J <m° x (v-2) , phase F 2 , (25) 

which are independent of c. These conditions also lead to m\ ±n =0 (n = 1, . . . , c — 1) 
which ensures that the network state does not switch from one condensed pattern to 
another. The same relation m = ±m^<5 M ,\ (M = 1» • • • » c ) holds from any time-step to 
the next one giving rise to the phase boundaries of the frozen-in states. In phases F± 
and F% the system is not useful for information processing but, as will be seen below, 
the frozen-in states become destabilised in the presence of synaptic noise (T > 0) and, 
eventually, lead to dynamically useful fixed-point or oscillating states. 

In figure Q] there is a phase R of retrieval fixed-point states for large v that 
reflects the dominance of the Hebbian synapses, with stationary overlaps = 8^1 
(fi = 1, . . . , c). The upper and lower phase boundaries of R end at Jo = ±0.4 for 
v = 1 which has been obtained analytically before for Little's model in the absence 
of noise |221 125] . A phase S of symmetric or symmetric-like states of equal or similar 
overlap components, respectively, appears for not too large Jo > 0. This phase 
exhibits a succession of multiple discontinuous transitions of the overlap vector m 
for intermediate values of v that will be shown below in connection with the phase 
of correlated states, which is the grey area in the figure [T] It is appropriate to note 
here that the latter is a phase that arises from the competition between sequential and 
Hebbian processing and it is not present in Little's model with pure Hebbian synapses. 
There is also a phase E of period- two cycles with m^ +2 = for fx = 1, . . . , c mostly 
for negative Jo, as shown below in figure 2 for one of the overlap components. Phase 
E exhibits a similar behaviour as that in phase 5* with multiple transitions but now 



Recurrent neural network model with a synchronous dynamics 



9 



to a variety of period-two cycles, in place of fixed-point states. 

In figure [2] we show the period-two cyclic behaviour within phase E for a single 
component, the other components behave in a similar way, for a typical v = 0.3 and 
two negative values of Jo within that phase, as indicated. In the upper part of the 
phase the stationary oscillation is between positive overlaps and in the lower part the 
oscillation is between ±m. 



m 
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(a) Jo = -0.1. 
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-0.9 
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t 



(b) J = -0.3. 

Figure 2. Evolution of a single overlap (the other components behave in a similar 
way) in phase E for v = 0.3, initial overlap = 0.4<5 M i and a = = T in (a) the 
upper part of the phase with Jo = —0.1, and in (b) the lower part with Jo = —0.3. 



The fixed-point solutions for one of the overlap components at a = = T for a 



typical Jo = 0.2 in phase S and the whole range of v is shown in figure 3(a) There 
is a finite number of bifurcations at specific values of v, in both the white and gray 
regions in that phase ending at the retrieval phase with m\ = 1. All the other overlap 
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(b) i/ = 0.6. 

Figure 3. Multiple transitions of one of the overlap components within the whole 
range of v (a) and correlation coefficients Cd defined in the text for various values 
of Jo (b). Both figures were generated for c = 10, a = = T and initial overlap 
m° = 0.45 M i (n= l,...,c). 



components follow a similar behaviour with transitions not necessarily of the same 
size but at the same values of v. We have studied the fixed-point solutions in both 
symmetric and correlated states calculating the correlation coefficients Cd as a function 
of the distance d, as shown in figure 3(b) for a fixed v — 0.6 and different values of Jo, 
as indicated. Either Cd decreases to a finite value, which is typical of symmetric-like 
fixed-points, or Cd decreases to zero, which is a characteristic of correlated states. The 
numerical criterion chosen for the latter employed in the construction of the gray region 
of figure [1] is that C5 < 0.02 for the maximum distance d — 5. The non-monotonic 
behaviour of Cd with Jq reflects the reentrance region to the phase of correlated states 
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Figure 4. Phase diagram of stationary states for c = 10, a = 0, T = 0.2 and 
initial overlap = 0.4(5^1 (fi = 1, . . . , c). R is a retrieval phase, S is a phase 
of symmetric-like states, P is a paramagnetic phase, the regions D are phases of 
correlated fixed-point states and E\ and E2 are phases of cyclic states. 

In order to illustrate the role of synaptic noise on the behaviour of the network, 
we show in figure [4] the (y, Jo) phase diagram of stationary states for a = and 
T = 0.2. For v w 1, the model has a similar behaviour to that of Little's model 
[221 ES] . There is a retrieval phase R with m ~ (mi, 0, . . . ,0) and mi assuming values 
in the range 0.9 < mi < 1, depending on the parameters v and Jo. The frozen-in 
cyclic states in the phase F2 at T = = a become destabilised by synaptic noise for 
all v. For the larger v they go into a paramagnetic phase with m = and for the 
smaller v they become period-two cycles with overlaps that evolved from the initial 
value. The cyclic states in region E\ are reminiscent of those in the feed-forward 
network [30] , with each overlap component oscillating between a larger and a smaller 
positive value. In fact, for a = = Jo we recover the results of 30 , since in this case 
the equations for the order parameters are precisely the same in the layered and in the 
recurrent networks. The overlap components in phase £2 are m^ = (— 1) m^, each 
one exhibiting usually a different amplitude m M . The frozen-in states in phase Fi for 
a — = T are destabilised by synaptic noise and become symmetric or symmetric-like 
states in phase S. This is now a phase that ends at two phases of correlated fixed- 
point solutions in the two disjoint regions D, that differ in the rate at which Cd goes 
to zero. In the lower region D, we have C'd ~ for d = 3 whereas in the upper region 
D, Cd ~ for d = 5. As can be seen from figure HI the range of values of v where the 
network evolves to correlated fixed-point states can be enhanced by an increase of Jo . 

To illustrate the robustness of the different phases with respect to synaptic noise, 
we show in figure \5\ the (v, T) phase diagram for a — and a small Jo = —0.2. 
Although the oscillation amplitudes of the overlap components in phases E\ and Ei 
decrease with increasing T, the cyclic solutions are stable even for a relatively large 
synaptic noise. 

We consider now the effects of stochastic noise due to a macroscopic number of 
patterns, p — otN, employing the procedure of Eissfeller and Opper [32]. Since the 
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Figure 5. Phase diagram of stationary states for c = 10, a = 0, Jo = —0.2 and 
initial overlap = OAS^i (fj, = 1, . . . , c). The phases are those of figure [4] 



construction of a phase diagram using this method is a prohibitive task due to the slow 
dynamics for finite a [25], we concentrate on the stability of some typical states. First 
we study the cyclic states favoured by dominating sequential synapses, that is for small 



In figures [6(a)1 and [6(b)] we illustrate, respectively, the dynamics of m\ and the 



stability to stochastic noise of a stationary overlap component (the other components 
behave in a similar way), both for a state in phase E\, when Jo = —0.02, v = 0.1 and 
T = 0.2. Figure 6(a) shows, for a = 0.01, that m\ keeps oscillating between the upper 



and lower values at consecutive time-steps without any significant variation in the 
amplitude with the asymptotic state being reached for t ~ 40 time steps, suggesting 
that the cyclic states in phase E\ are stationary states of the network dynamics for 
small values of a. The cycles decrease in amplitude with increasing a within that 
phase and change into symmetric-like states for larger a, as shown in figure [6(b)] 

The cyclic states in phase E-i turn out to be stable for higher stochastic noise 
as shown in figure [7] by the dynamics of m\ for J = —0.3, v = 0.1, T = 0.2 and 
two values of a. Indeed, for a = 0.5 the overlap component keeps oscillating with 
no change in the amplitude after a transient period, indicating stability to stochastic 
noise, whereas for a — 0.7 the amplitude is already decreasing, indicating that the 
cycles are unstable for that load of patterns. The reason for the increased robustness 
to stochastic noise of the cycles in phase E2 , in contrast to those in phase E\ , is that 
the former are deeper in the cyclic region, with a larger negative Jo for the same initial 
overlap We comment in the last section on the relative robustness to stochastic 
noise of both cyclic phases. 

We consider next the stability of correlated fixed-point states in the presence of 
stochastic noise which are expected for dominating Hebbian synapses in the presence 
of sequential interactions and we resort again to the EO procedure. The dynamics of 
m\ up to t = 300 time steps was studied for a state within each region D of figure 
[U In figure [8] are shown results in the lower region D with v = 0.83, Jo = —0.25, 
and T — 0.005 in order to extract mainly the effects of stochastic noise for two values 
of a. The upper curve, for a = 0.006, indicates that the correlated fixed-point state 
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Figure 6. Dynamics of one overlap component in the cyclic phase E\ 
for a = 0.01 (a), and stationary overlap for increasing stochastic noise a with 
transition to the symmetric-like phase S at a ss 0.06 (b), both for c = 10, T = 0.2, 
Jo = —0.02, v = 0.1 and initial overlap = 0.45^1 (fi = 1, . . . , c). These results 
were generated by the Eissfeller-Oppcr procedure with Nt = 5 x 10 5 trajectories. 



is stable with a stationary overlap vector given by m ~ (0.75, 0.25, 0, 0, 0.25). 
This state is already unstable for a somewhat larger a = 0.01, as suggested by the 
lower curve, since the overlap w\ is decreasing towards a value that is quite different 
from mi ~ 0.75. In fact, we obtained an overlap vector given approximately by 
m ~ (0.34, 0.30, 0.21, 0.14, 0.09, 0.07, 0.09, 0.14, 0.20, 0.28), indicating that the network 
is evolving to a symmetric-like state. 

We have also investigated the stability of states in the upper region D and in the 
retrieval phase, and found similar results to those in the lower D region, in the first 
case, and results reminiscent to those for Little's model, in the second case, indicating 
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Figure 7. Dynamics of m\ in the cyclic phase E2 for c = 10, Jo = —0.3, v = 0.1, 
T = 0.2, initial overlap rrfi^ = 0.4<5 M i (/1 = 1, . . . , c) and two levels of stochastic 
noise: a = 0.5 (crosses) and a = 0.7 (circles). These results were generated by 
the Eissfeller-Opper procedure with Nj< = 5 X 10 5 trajectories. 
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Figure 8. Dynamics of m\ in the lower phase D of correlated fixed-point states 
for c = 10, J = -0.25, v = 0.83, T = 0.005, initial overlap ra° = 0.4<5 M i 
(/j, = 1, . . . , c) and two levels of stochastic noise: a = 0.006 (crosses) and a = 0.01 
(circles). These results were generated by the Eissfeller-Opper procedure with 
N T = 5 X 10 5 trajectories. 



stability for small values of a. 
5. Summary and conclusions 

The generating functional approach has been used in this work to study the 
synchronous dynamics, the stationary states and the transients of a recurrent neural 
network model with synapses generated by the competition between symmetric 
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sequence processing and Hebbian pattern reconstruction. Either the numerical 
procedure of Eissfeller and Opper, based on the GFA, to simulate paths of single- 
spin states or a simpler alternative procedure have been used in this work to obtain 
results in the presence or absence of stochastic noise due to the load of a macroscopic 
number of patterns. There is a single time scale in the dynamics (the step of unit 
size) leading to both fixed-point and cyclic behaviour of period two. The latter arises 
from the synchronous updating of all units at every time step and it is enhanced by 
two features: the sequential interactions and the self-interaction of the units. The 
mean-field dynamics done here allows us to study the stability of the fixed-point and 
cyclic states as well as the transitions between them. 

In distinction to Little's model (the case v = 1 of purely Hebbian synapses) where 
the cycles of period two only appear as frozen-in states in the absence of noise and 
become destabilised by synaptic or stochastic noise, there appear now in the case 
where < v < 1 also stable dynamic cycles of period two, either with or even without 
noise. These are cycles that evolve from the initial overlap to a stationary state, and 
they appear in a large region of the phase diagram. 

The retrieval behaviour and the fixed-point correlated states are also enhanced 
by the presence of a self-interaction and in this work we investigated the changes in 
the phase diagrams due to that interaction. Phase diagrams of stationary states were 
obtained in this work and it was shown that fixed-point correlated states are clearly 
separated from both phases of cyclic states already for a small but finite synaptic 
noise, independently of the size (and even in the absence) of a self-interaction. This 
suggests, within the limited conclusions that can be drawn from an attractor neural 
network model, that there should be no interference of the oscillating states produced 
by the synchronous dynamics with the correlated fixed-point states that are crucial in 
visual task experiments. 

We comment, next, on the last summation in the synaptic interaction given by 
([3]), which is responsible for the noise term in the local field h\. One may consider a 
more general form p>c ^B^p^j with an interaction matrix of the same form 

as (fT"2")) for the condensed part, 

B w = b8 M , p + (1 - 6) p+i + S„, P -i) (26) 

with < 6 < 1, which could be equal to v. The case we considered here, for simplicity, 
is a Hebbian noise with 6=1. The more general form has been used in the case of 
the layered feed-forward network [30j and one may infer from the results of that work 
the qualitative changes on the results presented here when b = v. It turns out that 
the pure Hebbian case underestimates slightly the storage capacity of the fixed-point 
states for large values of v. On the other hand, the storage capacity for almost pure 
cyclic behaviour, with small is, is overestimated by a pure Hebbian noise, and this is 
one of the reasons for the large value of a for which the cyclic states are still stable in 
both cyclic phases E\ and E2, as found in section 4. 

Finally, there are a few features of the model which are worth pointing out. 
First, is that the results obtained with the symmetric interactions Jij in ([3]), are quite 
different from those for Little's model. One of these results is the presence of fixed- 
point correlated states, another one is the presence of stable cycles in phases E\ and 
i?2j in distinction to the absence of cycles in Little's model with noise. Furthermore, 
excitatory self-interactions enhance fixed-point correlated states as shown by the 
enlarged upper part of the D phase. Also, inhibitory self-interactions are not only 
responsible for the enhancement of the fraction of flipping spins, a feature that is 
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known from Little's model, but even for the presence of fixed-point correlated states 
as demonstrated by the lower part of the D phase. The presence of the various 
stationary states shown in this work depends on the relationship between the self- 
interaction J , the initial overlap m° and the value of v. These quantities shape 
the basins of attraction of the simplest stationary states and other states could be 
considered with alternative initial states if necessary. An interesting extension of this 
work would be to consider random self-interactions. 
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